THE PRIMITIVES AND ANTIPODE IN THE HOPE ALGEBRA OF 
SYMMETRIC FUNCTIONS IN NONCOMMUTING VARIABLES 



AARON LAUVE AND MITJA MASTNAK 

Abstract. We identify a collection of primitive elements generating the Hopf algebra 
NCSym of symmetric functions in noncommuting variables and give a combinatorial formula 
for the antipode. 



1. Introduction 

The Hopf algebra NCSym of symmetric functions in noncommuting variables was intro- 
duced in [6], following the work of Wolf, Rosas, and Sagan [18, 16]. We refer the reader to 
these sources for details on its realization as formal sums of monomials invariant under 
(for all n > 0). For our goals, it suffices to describe NCSym abstractly in terms of generators 
and relations, which we do in Section 3. 

The Hopf algebra NCSym is cocommutative (by definition) and freely generated as an 
algebra (essentially the main result of Wolf). Following [6], we choose the atomic set partitions 
n as a free generating set (see Section 3). The Cartier-Milnor-Moore theorem then guarantees 
that NCSym is isomorphic to il(£(II)), the universal enveloping algebra of the free Lie algebra 
generated by H. This note grew out of an attempt to realize this isomorphism explicitly. 

In Section 2, we record some useful combinatorial machinery. Section 3 contains a precise 
definition of the Hopf algebra NCSym as well as the statements and proofs of our main results. 
In Section 4, we comment on: (i) an important connection between NCSym and super character 
theory; and (ii) key structural features of our proofs that will be further developed in [12]. 

Acknowledgements. We thank Marcelo Aguiar and Nantel Bergeron for useful conversa- 
tions and for pointing us to the related work of Patras and Reutenauer. 

2. Combinatorial Preliminaries 

We record some useful shorthand for manipulating set partitions and set compositions. 
Throughout, we let N and P denote the set of nonnegative integers and positive integers, 
respectively. Also, given n S P, we let [n] denote the subset {1,2,..., n}. 

2.1. Set partitions. Fix X C P and let A = {Ai, . . . , Ar} be a set of subsets of X. We say 
that A is a set partition of X, written A h X, if and only ii Ai Li ■■■ L) Ar = X , Ai ^ (1) (Vz), 
and Ai n = (Vi ^ j). We order the parts in increasing order of their minimum elements. 
The weight |A| of A is the cardinality of X and the length i{A) of A is its number of parts 
(r). In what follows, we lighten the heavy notation for set partitions, writing, e.g., the set 
partition {{1, 3}, {2, 8}, {4}} as 13.28.4. We write H(X) for the set partitions of X and H(n) 
when X = \n\. 
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Given any j4 C N and A; G N, we write A'^'^ for the set 

A+f' ■={a + k\ae A}. 

By extension, for any set partition A = {Ai,A2, ... , Ar} we set := {Af^,A^'', . . . , A+''}. 
The operator {~)~^^ has a complement (-)^ called the standardization operator. It maps set 
partitions A of any cardinality n subset X C P to set partitions of [n], by defining as the 
pullback of A along the unique increasing bijection from [n] to X. For example, (18. 4)''' = 13.2 
and (18.4.67)^ = 15.2.34. Given set partitions B h [m] and C h [n], we let B|C denote the 
set partition B U C"*"™" of [m + re]. 

Definition 1. A set partition A = {Ai,A2, . . . ,Ar} of [n] is atomic ("connected" in [11]) if 
there does not exist a subset B C A and an integer m < n such that B h [m]. Conversely, A 
is not atomic if there are set partitions B of [re'] and C of [n"] splitting A in two: A = B C. 

For example, the partition 17.235.4.68 is atomic, while 12.346.57.8 is not. The maximal 
splitting of the latter would be 12; 124.35:1. We denote the atomic set partitions by 11. 

If A is a set partition with r parts, and K CI [r], we write Ak to denote the sub partition 
{Ak\k£ K} C A. For example, if A = 17.235.4.68, then A{i^3^4} = 17.4.68. 

2.2. Set compositions. Fix K and let 7 = (71, . . . ,7^) be a sequence of subsets of K. 
We say that 7 is a set composition of K, written 7 1= i^T, if and only if 71 U • • • U 7^ = -ftT, 7i / 
(Vi), and 7i n 7j = (Vi 7^ j). The weight I7I and length i (7) are defined as for set partitions. 
We use "I" in place of "." in our shorthand for set compositions, e.g., the set composition 
({3, 8}, {1, 2}, {4}) is abbreviated as 38|12|4. We write r(i^) for the set partitions of K and 
r(r) when K = [r]. 

If 7 is a set composition of X and K X, we write for the induced set composition of 
K. For example, if 7 = 38|12|4 and K = {3,4,8}, then 7]/^ = 38|4. Similarly, 7j{i^3} = 3|1. 
Note that 7J 113} is not the same as 7{i,3}- Following the notation introduced for set partitions, 
we let 7{i,3} denote the subsequence 38|4 of 7. 

Given two set compositions ^, p\= K, we say that 7 refines p, written 'j y p,if each block of p 
is the union of a contiguous string of blocks of 7. For example, 2|4|3|17|9 >- 234|179 >- 123479. 

2.3. Set compositions as functions on set partitions. Let A be a set partition of X 
with r parts and suppose 7 = (71, . . . , 7^) is a set composition of K C [r]. We define a new 
set partition 7 [A] as follows: 

(1) 7[A]:=A^,^|A^,^|...|A^/. 
See Figure 1 for several examples. 
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Figure 1. Set partitions 7 [A] for several exaniples of 7 and A. 
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3. Structure of NCSym 

Let NCSym = 0„>o ^CSym^ denote the graded Q vector space whose nth graded piece 
consists of formal sums of set partitions A € n(n). We give NCSym the structure of graded 
Hopf algebra as follows. The algebra structure is given by 

(2) A.B = A|B and IjvcSym = , 

where is the unique set partition of the empty set. The coalgebra structure is given by 

(3) A(A) = ^ (Ak)^ ^ (Al)^ and e(A) = for all A . 

K[z)L=[r] 

Here, A is a set partition with r parts, and i^T U L = [r] is understood as an ordered disjoint 
union, i.e., K U L = [r], K n L = h, and K \J L L \J K. 

In terms of the symmetric function interpretation of NCSym, the formulas above correspond 
to working in the basis of power sum symmetric functions. The compatibility of product and 
coproduct is proven in [6], the product formula is proven in [7], and the coproduct formula 
is proven in [5]. A combinatorially meaningful formula for the antipode in NCSym has been 
missing until now (Theorem 6). 

Evidently, NCSym is cocommutative and freely generated by II. The Cartier-Milnor-Moore 
theorem guarantees algebraically independent primitive elements p(A) of NCSym associated 
to each A € "P. We find them below (Theorem 2). 

3.1. Primitive generators of NCSym. We aim to prove the following result. 

Theorem 2. Let T'(r) denote the set compositions 7 of [r] with 1 € 71. If A is a set partition 
with r parts, then 

(4) p{A) := (-1)^W-S[A] 

7er'(r) 

is a nonzero primitive i/ A E II and zero otherwise. 

Remark. An arbitrary choice was made in (4), namely demanding that the distinguished 
element 1 belongs to the first block of 7. Different choices of distinguished elements (and 
distinguished blocks) give rise to different sets of primitives. Summing over these choices pro- 
duces a projection operator onto the space of all primitives. This operator can be understood 
in the context of the work Patras and Reutenauer on Lie idempotents [13, 14]. Fisher [9] uses 
similar idempotents to work out primitive formulas for several Hopf monoids in species. His 
formulas, which were discovered independently, also give rise to (4). 

To prove Theorem 2, we need a lemma about left quasi- shuffles. Let P = (fin(2''°)) denote 
the free monoid generated by the finite subsets of F and let QP denote the corresponding 
free algebra. We use | to separate letters in the words tt; € P. Given a word u = ui\ - ■ ■ \uk 
on k letters and an index i < k, we write ujj] for the prefix ui\ - ■ -{ui and for the suffix 
\ ■ ■ ■ \Uk. 

We say that words u = u\\ - ■ ■\uk and v = vi \ ■ ■ • \vi vn'P are disjoint if (|J^ Uj) n (IJ^ Vj) = 0. 
(We identify the set compositions T{K) with the words if G P that further satisfy WiCiWj = 
for i ^ j and \Jj wj = K.) 

The quasi-shuffte u uj v two disjoint words u,v £ P is defined recursively as follows: 

• u uj = u and uj f = 
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• if n = a\u' and v = b\v', then 

u i-ij V = {a\w : tt; G u' uj ti} u {a5|tt; : € n' lu u'} u {b\w : w € n uu ti'j . 

Here denotes the unique set composition of the emptyset and "a&" denotes the union aUb, 
a single letter in P. The quasi-shuffle governs the formula for the product of two monomial 
symmetric functions in noncommuting variables. We need a subset of these that we call the 
left quasi-shufftes: 

u <li V = {a\w : w € n' Lu iij U {ab\w : w G u' uj 

for nonempty disjoint words u = a\u' and v = b\v' in P. (Note that the recursive definition 
involves uj, not uj.) 

Example 3. Consider the set compositions 1|3 and 24. We have 

1|3 CIj 24 = {l|3|24, 1|234, 1|24|3, 124|3} . 
Note that for each left quasi-shuffle 7 above, 7j{i,3} = 1|3 and 7j{2,4} = 24. 

Lemma 4. Let T'{r) denote the set compositions 7 of [r] with 1 G 71. Given any partition 
K [:) L = [r] with 1 ^ K C^[r\, we have 

{-lf^^h\K®l\L=Q, 

7er'(r) 

as an element of QP QP. 

Proof. Consider a term u® v m. the sum. (The hypothesis K 7^ [r] guarantees that f 7^ 0.) 
The compositions 7 that satisfy 7ji<- = n and 7Jl = f are precisely the left quasi-shuffles 
M UJ f . We now establish a bijection between those of even length and those of odd length. 
This will complete the proof. 

A left quasi-shuffle w G u lL f falls into one of two types according to whether or not the 
first letter of v appears as a letter in w. after beginning with some (possibly empty) initial 
prefix of u, say up to the ith letter Uj, the rest of the word w looks like either Uj+i |f 1 |tt)' or 
UiJ^iVi\w' for w' in nt*"*""*^] uj Here, again, Uj+i^i denotes Uj+i U vi. The indicated pairing 
w i-> 4>{w) (nj+i|fi !->■ Ui+iVi) decreases the number of letters by one. Thus w and 4>{w) 
contribute opposite signs to the coefficient oi u®v. □ 

Proof of Theorem 2. Since A is cocommutative, we need only consider the terms 7[A]x~'' ® 
7[A]i^ from each A(7[A]) satisfying 1 ^ K. Notice that 7[A]/v- = (7];^') [A] for some K' C [r] 
(with 1 G ir' if 1 G 71). Thus 

{-if^^^ E 7[A]i^^0 7[A]L^ 



is the same sum as 



E E (-l)'^"^(7jir)[AN(7jL)[A] 



Kl:JL=[r] ■yeT'{r) 



or even 



E E {-lY^^h\K^l\L][A(^A] 



\Kl^L=[r] 7Gr'(r) 
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Lemma 4 reduces this expression to (0) [A A] = when K [r]. When K = [r], the 
expression is precisely p{A) (8) 1. Conclude that p{A) is a primitive element when A is atomic. 

To show that p{A) is nonzero when A is atomic, we merely remark that 7 [A] has at least 
as many atoms as 7 has parts. It is only when A E II and 7 = [r] that a single atom is 
obtained: 7[A] contributes A to the sum p{A) only when 7 = [r]. Thus p{A) ^ 0. 

We now show that p{A) = when A is not atomic. Suppose A = A'| A" and put i (A) = 
r,£{A') = r' . (Note that r' < r by assumption.) Divide the set compositions 7 € T'{r) into 
two types according to the following dichotomy. If 7j is the first letter, from the left, satisfying 
7i n {r' + 1, . . . , r} 7^ 0, then either 7^ n {1, . . . , r'} is empty or it is not. The pairing 7 1— 0(7) 
(7j_i|7i I— 7> 7i_i7i) decreases the number of letters by one. However, the difference is not 
visible at the level of functions on A. That is, 7[A] = 0(7)[A]. This completes the proof. □ 

Corollary 5. The set {p{A) \ A € II} comprises irredundant (algebraically independent) 
generators of the Lie algebra of primitive elements of NCSym. 

Proof First we show algebraic independence of {p(A) j A € 11}. Let < be a total order on 
the set n satisfying A < A' when |A| > |A'|. If we extend < to a lexicographic ordering of 
n in the usual manner, then the leading (minimum) term of p{A) is A. (As remarked in the 
proof above, the only term in p{A) with one atom is A.) Conclude that any polynomial in 
the p{A)s (A € n) has the same leading term as the corresponding polynomial in the As. 
Hence the p{A)s freely generate NCSym. 

Turning to the Lie algebra of primitive elements in NCSym, we recall the construction of 
Hall polynomials. Given an ordered alphabet X and a word w = xi . . . xt over X, we say 
that w is a Lyndon word if w is lexicographically smaller than all its proper suffixes Xi - ■ ■ xt 
(i > 1). A classical result has that all Lyndon words w have a unique proper decomposition 
w = uv with V Lyndon of maximum length. See [15]. We define the Hall polynomial [[w]] 
by forming the Lie bracket [u, v] at successively smaller Lyndon factorizations. For example, 
if w = aabb, then the Lyndon factorization of w is {a, abb); next, abb is further factored as 
{ab,b) and ab is factored as (a, 6). The resulting Hall polynomial is [[w]] = [a, [[a,b],b]]. 

If w is Lyndon, then the leading term of [[w]] is w. A consequence is the classical result 
that the Hall polynomials {[[w]] \ w is Lyndon} form a basis of the free Lie algebra generated 
by X. Turning to NCSym, the first paragraph of the proof shows that we may replace 
the alphabet n with the alphabet {p{A) \ A € II}. Conclude that the Hall polynomials 
[\p{A')p{A") ■ ■ •p(A(*))]], with A'jA"| • • • |A(*) Lyndon in the atoms A(*\ form a basis of the 
Lie algebra of primitive elements in NCSym. □ 

3.2. The antipode of NCSym. We aim to prove the following result. 

Theorem 6. Suppose A is a set partition with r parts and let r(r) denote the set compositions 
of [r] . The antipode S of NCSym acts on A by 

(5) S{A)= ^ (-1)^(^)7[A]. 

7er(r) 

Remarks. 1. This description of the antipode typically contains many cancellations. For 
example, it says that 5(12.3) = —(12.3) + (12.3) + (1.23). There may even be cancellations 
when A is atomic. We invite the reader to compute £'(14.2.3), which a priori has 13 terms, 
but in fact has only nine. On the other hand, (5) is irredundant for many atomic A. 

2. In case A is not atomic, we can do better. Suppose A = A'|A"| • • • |A(*) is a splitting 
of A into atomic pieces, and let £ (A^*)) = with ~ Fhially, let r(V) denote all 



6 



AARON LAUVE AND MITJA MASTNAK 



refinements of the set composition 

V = {{r-rt+l, . . . ,r}, . . . ,{ri + l, . . . ,ri+r2}, {1, • • • 

Then 

(6) S{A)= E (-1)'^"^7[A]. 

7er(V) 

This follows immediately from the fact that S is an algebra antimorphism and (5) holds 
on atomic set partitions. Using this formula, we may express 5'(13.2.4) using three terms, 
S'(13.2.4) = (1.24.3) - (1.23.4) - (1.2.34). Using (5) would have required us to write down 13 
terms, 10 of which would cancel. The relationship between (6) and Theorem 14.31 of [1] will 
be explored in [12]. 

Proof of Theorem 6. Since the antipode is guaranteed to exist in graded connected bialge- 
bras, we need only check that (5) provides a left convolution inverse of id. Writing m for 
multiplication in NCSym, we have 

m(5 0id)A(A) = m(5(g)id) I ^ A/^^ (g) A^H = m(5 id) I ^ K[A](^L[A] 

\KijL=[r] J \_fs:uL=[r] 

(viewing K and L as set compositions with one part) 

= E I E i-if'hmA]]\ 0L[A] 

K\jL=lr] \76r|jf| / 

E E(-i)'^"^(7i^))[A]. 

yK\jL=[r] ■yeTK J 

We show that this sum is the zero function on A. We have 

E E(-i)'^"^(7i^)= E(-i)'^"^7 + E E 

KUL=[r] ■yeTK l<^'^[r] _fS'UL=[r] -yf^Tx 

= E E (-i/^"''"^(7'i^) -EE (-i/^"'"^(7i^) 

0CLC[r] 7Gr[^] KldL=[r]'yGTK 
7=7' I ^^M 

= 0, 

as claimed. We conclude that m(S' (8> id) A( A) = for |A| > 0, which completes the proof. □ 

4. Summary Remarks 

4.1. Super character theory. Let Fg be a finite field with q elements. The classification 
problem for irreducible representations of the upper triangular groups C/„(Fg) is known to 
be of wild type. After the work of Andre and Yan [2, 19], it seems a good first step at 
understanding the character theory of Un(^q) is to study its supercharacters and superclasses. 
Superclasses are formed by clumping together certain conjugacy classes of C/„(Fg). To each 
superclass is associated a supercharacter, which is the corresponding sum of characters. See 
[8] for an excellent exposition by Diaconis and Isaacs. 

Following this approach to the problem, and mimicing the classical constructions in the 
representation ring of the symmetric groups, Thiem [17] gave the space of supercharacters 
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SCq a Hopf algebra structure, with product and coproduct coming from superinflation and 
restriction.^ The result was something that bore a strong resemblance to NCSym for q = 2. 
One of the main topics of the AIM workshop [4] was to explore this connection and see what 
could be said for q arbitrary. Quite a lot of progress was made in several directions. Relevant 
to the present discussion is that SC2 is indeed isomorphic to NCSym as Hopf algebras. 

The isomorphism above is straightforward, simply taking superclass functions ka to mono- 
mial symmetric functions mjs^. (See [17] and [6] for notation.) In light of this, it would be 
very interesting to have analogs of (4) and (5) for the monomial basis. Some exciting progress 
was made in this direction on the last day of the workshop, but some details still need to be 
checked before any formal statement can be made [3]. 

4.2. Transfer of structure. In Section 3, we used the idea of set compositions as functions 
on set partitions to formulate our results. As the proofs of these results indicate, this idea can 
be mined further. There is a graded connected cocommutative Hopf algebra structure on QP 
which is freely generated as an algebra by fin(2'^). Formulas for primitives and the antipode 
in QP mimic (4) and (5). 

More is true. In fact, the QP formulas engender (4) and (5) via a transfer of structure 
coming from a measuring of Hopf algebras. We leave the details to [12], where further examples 
of transfer of structure will be worked out. We quote a key theorem from that work. 

Theorem 7. Let A, B he Hopf algebras and let C he a coalgehra. Suppose 9 : B C ^ A is a 
covering (a surjective coalgehra map that measures B to A). Let l: A ^ B ^ C he any linear 
section of 6, that is, 9 o l = id. Then the following hold. 

(1) Lf p ^ B is primitive, then for every c (z C the element 9{p, c) (z A is primitive. 

(2) Sa = 9o{Sb(^ id) o i. 

Here, QP covers NCSym by taking C to be the free pointed coalgehra on set partitions; 
the covering ^(7 (g) A) is the evaluation 7[A] discussed in Section 2.3. In [12], we also discuss 
coverings by NSym, where NSym is the Hopf algebra of noncommutative symmetric functions 
[10] freely generated by symbols i7„ that comultiply as 

i+j=n 

Such coverings exist for every graded cocommutative Hopf algebra A and are given by setting 
C to be the underlying coalgehra of A and 6 to be the unique covering for which 9{I{n <8> 
a) := vr„(a), where vr^ is the projection to the n*^ graded component of A. Again, primitive 
and antipode formulas in NSym are transfered via Theorem 7. Formula (2) in the theorem 
simply recovers Takeuchi's formula for the antipode, whereas Formula (1) is used to obtain 
Takeuchi-type formulas for primitives in A. In particular, we obtain generators for the space 
of primitives (analogous to Theorem 2) as well as a projection onto the space of all primitives. 
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